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The relationship between efficient quantum gate synthesis and control theory has been a topic 
of interest in the quantum control literature. Motivated by this work, we describe in the present 
article how the dynamic programming technique from optimal control may be used for the optimal 
synthesis of quantum circuits. We demonstrate simulation results on an example system on SU{2), 
to obtain plots related to the gate complexity and sample paths for different logic gates. 
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I. INTRODUCTION 

One of the important pursuits in the field of quantum 
computation is the determination of computationally ef- 
ficient ways to synthesize any desired unitary gate from 
fundamental quantum logic gates. Of special interest are 
the bounds on the number of one and two qubit gates 
required to perform a desired unitary operation (termed 
the gate complexity of the unitary). This may be con- 
sidered a measure of how efficiently an operation may be 
implemented using fundamental gates. 

An approach linking efficient quantum circuit design 
to the problem of finding a least path-length trajectory 
on a manifold was taken up in [l| ; the path length was re- 
lated to minimizing a cost function to an associated con- 
trol problem (with specific Riemannian metrics as the 
cost function). This approach was later generalized in 
[31 to use a more general class of Riemannian metrics 
as cost functions to obtain bounds on the complexity. 
In [3| the authors use Pontryagins' maximum principle 
from optimal control theory to obtain a minimum time 
implementation of quantum algorithms. Alternative tech- 
niques using Lie group decomposition methods to obtain 
the optimal sequence of gates to synthesize a unitary were 
developed in [J, [a, Q . 

In this article we use the method of dynamic program- 
ming from the theory of optimal control to determine the 
sequence of one and two qubit gates which implement a 
desired unitary. We solve the problem using one and 
two qubit Hamiltonians as the control vector fields, in 
contrast to the approach in [l| which used the concept 
of 'preferred' Hamiltonians. In addition we demonstrate 
numerical results on an example problem in SU{2) and 
obtain controls which may be then be used to split any 
gate into a product of fundamental unitaries. 

The organization of this article is as follows. In Sec- 
tion [ll] we provide a review of the definitions of gate 
complexity, approximate gate complexity and the con- 



trol problem associated with the bounds on these quanti- 
ties. We describe, in Section [TTTl how this control problem 
can be solved using Dynamic Programming techniques 
from mathematical control theory. This is followed by 
a demonstration, in Section HVl of the theory developed 
to an example problem on SU{2); wherein simulation re- 
sults and sample optimal trajectories are obtained. 



II. PRELIMINARY CONCEPTS 

In this section we recall the notion of gate complexity 
and its relation to the cost function for an associated 
control problem as in [^ . 



A. Gate complexity 

As outlined in [7|, Chapter 4] , in quantum computation 
each desired quantum algorithm may be defined by a 
sequence of unitary operators Ui , U2 , ■ ■ ■■ Each of these 
Uj is an element of the Lie group S'[/(2") and represents 
the action of the algorithm on an n-qubit input. The 
gate complexity G(Uo) of a unitary C/q is the minimal 
number of one and two qubit gates required to synthesize 
Uo exactly, without help from ancilla qubits [3|- The 
complexity of the algorithm is a measure of the scaling 
of the amount of basic resources required to synthesize 
the algorithm, with respect to input size. 

In practice however, computations need not be exact. 
To perform a desired computation C/q, it may suffice to 
synthesize a unitary Uq with accuracy e, i.e \\Uo ~ C^oll ^ 
e. Here || ■ || denotes the standard matrix norm in a 
particular representation of the group. This notion gives 
rise to the definition of the approximate gate complexity 
G(C/o,e) as the minimal number of one and two qubit 
gates required to synthesize Uq up to accuracy e. 



B. Control problem 
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We outline below a control problem on the Lie group 
SU{2") such that the cost function associated with it 



provides upper and lower bounds on the gate com- 
plexity problem. The system evolution for the control 
problem occurs on SU{2") with associated Lie algebra 
ro = su(2"). Note that in this article the definition of 
su(2") is taken to be the collection of traceless Hcrmitian 
matrices (which differs from the mathematicians' conven- 
tion by a factor of i). The system equation contains a set 
of right invariant vector fields Hi , H2 ■ ■ ■ H^ which cor- 
respond to a set of one and two qubit Hamiltonians. The 
Lie algebra generated by the set { iJi , i/2 • • • Hm } is as- 
sumed to be txi . This assumption along with the fact that 
S'C/(2") is compact imply that the system is controllable 
[8|(and hence the minimum time to move between any 
two points on SU{2'^) is finite). The system dynamics 
for the gate design problem is described as follows: 

^ = -^{Y.Vk{t)Hk]U, U e SU{T) (1) 



dt 



k=l 



with the initial condition C/(0) = Uo and with a bound 
C'max on the norm of the available control vector fields 
Hj using any suitable norm on their matrix representa- 
tion. The control v is an clement of the class of pieccwise 
continuous functions with their range belonging to a com- 
pact subset V of the real TTi-dimensional Euclidian space 
(R™). We denote this class of functions by V. Hence V := 
{v{.) \\/ i Vi : [0,00) -^ M,Vi is piecewise continuous}. 

Given a control signal v and an initial unitary C/g the 
solution to Eq ([T|) at time t is denoted by U{t;v,Uo). 
In addition, by a simple time reversal argument it can 
be seen that the problem of obtaining a desired unitary 
gate Uq starting from the identity can be reframed as a 
problem of reaching the identity element starting at Uq. 

Note the difference between the system described 
herein and that outlined in the control problem in [3|. 
In the present case, the control Hamiltonians used are 
the ones which generate the one and two qubit unitaries; 
therefore the concept of 'preferred' vs 'allowed' Hamil- 
tonians is not utilized here. The controls used may in 
fact be any bracket-generating subset of the vector fields 
which generate one and two qubit unitaries. 

We now define some terms to be used in this article: 
For Uq G 5t/(2") and w G V 

Time to reach the Identity using control v 

tu,{v) = mi{t > : C/(0) = f/o, 

[/(f) =/, dynamics in©}. (2) 

The infimum in Eq ([2]) is infinite if the terminal 
constraint U{t) = I is not attained. 

Cost Function 



has a finite positive maximum and minimum i.e 
Lmin < i{v) < imax- Notc that as long as i has 
a minimum greater than zero, the bounds on it can 
be recast in the form 1 < L„iin < ^('^)- 



Optimal Cost Function 



CiUo)= miJ{Uo,v) 



(3) 



This optimal cost function will be used to provide 
bounds on the gate complexity. 

Hence the control problem is to find the values of v 
in order to optimize the cost function. The boundedness 
of the time taken to achieve the desired objective (due 
to controllability), together with the boundedness of £, 
implies that the cost function is bounded. In addition, 
the control problem may also be generalized to systems 
evolving on any compact connected Lie Group A4 with 
the cost i{x, v) being dependent on both .t S A^ and 

vev. 



C. Bounds relating gate complexity and control 

We now recall results on the relation between the cost 
of the associated control problem and both the upper 
bound on the approximate gate complexity and the lower 
bound on the gate complexity [l|, ^ . 

We define 



Tmax := ^max { inf [ic/(u)]}. 



(4) 



where W1/2 is the set of one and two qubit unitary gates. 
Hence the total time to construct Uq from I or vice- versa 
is at-most G{Uo) x Tmax- Therefore for any element Uq 
of 5C/(2") we have [l| 

C([/o)<£maxG'([/o)r„,ax. (5) 

From 0] we have that a given unitary Uq in S't/(2") 
can be approximated to 0{e) using 0{C{UoYn^ / e^) one 
and two qubit unitary gates. Hence the upper bound on 
the approximate gate complexity satisfies 



aiu,,.)<oC^^^y 



(6) 



This motivates the solution to certain related optimal 
control problems in order to obtain bounds on the com- 
plexity of related quantum algorithms. In addition, the 
solutions to such optimal control problems help deter- 
mine the sequence of one and two qubit gates used to 
generate the desired unitary as described in the follow- 
ing section. 



J{Uo,v) 



tUo( 



e{v{s))ds, 



given the dynamics in Eq IH) with control v £ 
V where i : V -^ M is continuous and 



III. DYNAMIC PROGRAMMING FOR GATE 
COMPLEXITY 

In this section we introduce the tools of dynamic pro- 
gramming which have had widespread application in con- 
trol theory. We then apply this theory to solve the control 



problem associated with determination of the bounds on 
gate complexity and explain how to use the solution to 
the control problem to obtain the sequence of gates re- 
quired to reach any given unitary. 



A. Introduction to Dynamic Programming 

The dynamic programming principle states that: 'An 
optimal policy has the property that, whatever the initial 
state and optimal first decision may be, the remaining 
decisions constitute an optimal policy with regard to the 
state resulting from the first decision'!^, p. 83]. The use 
of this principle involves recursively solving a problem by 
breaking it down into several sub-problems followed by 
determining the optimal strategy for each of those sub- 
problems. For example, consider the following problem: 

Example III.l 

Let the state of a system be described by a vector in some 
vector space A4. Moving from one point to another is 
done by exerting a control chosen from a compact control 
set V (we assume full controllability of the system using 
controls from this set). Any control v exerted starting 
at a point U in this space leads to a point denoted as 
P{v, U), while incurring a cost. This cost of exerting the 
control may depend on the point at which the control 
starts being applied as well as on the control signal itself. 
The objective is to reach from a point A to a point B in 
that vector space while incurring as low a cost as possible. 
Let the cost of reaching B from any point U using control 
V be denoted by J{U, v). The cost at any point is denoted 
by C(U) , U £ M.. The dynamic programming principle 
implies: 



B. Use in the gate complexity problem 



C{U)< inf {C(P(u,C/)) + J(C/,w)}. 
t> e V 



(7) 



Also from the definition of C{U) we have that for any 
e > 0, there exists a control v* s.t 



C{U) + e > C{P{v\U)) + J(U, V*). 



(8) 



Hence, 



C{U)+e> \ni{C{P{v,U)) + J{U,v)]. (9) 

ti e V 

In the limit e — > we have that: 

C(C/)> inf {C(P(w,C/)) + J([/,w)}. (10) 

Equations ([7]) and pOp imply the dynamic programming 
equation 

C{U) = inUC{P{v, U)) + J{U, v)}. (11) 

11 s V 



Solving a control problem using this principle involves 
setting up and solving a recursion equation as above. 
There are several references which provide a detailed and 
rigorous introduction to this theory viz [10, [HI, U^ ■ We 
now apply this theory to obtain bounds on the gate com- 
plexity. 



By the procedure described in Example pil.ip in the 
previous sub-section, we have that the dynamic program- 
ming equation for the optimal cost function in Eq ^ is 



tAtu„{v) 



C{Uo) 



- inf 

vev 



e{v{s))ds- 



Xt<tu,iv)C{U{tAtuoiv);v,UQ)) 



(12) 



for all initial points Uq S 51/(2"). Here aAb := min{a, b} 
and xa is the indicator function of the set fi taking on 
the value of 1 inside the set and zero outside it. Thus, 

Xt<tuo is 1 if i < tuo- 

Now we describe a formal derivation to obtain the 
differential version of the dynamic programming equa- 
tion(DPE). For sufficiently small t we have from Eq ([72]) 
that: 



C{Uo) 




£iv{s))ds + CiUit;v,Uo))} (13) 



Now transposing C{Uq) to the right hand side, dividing 
by t and taking the limit as i — > we obtain: 



0= inf {t{v) + DC{Uo){U)\ 

( \ ra 

-i{Y,Vk{t)Hk}x 
fc=i 



0= inf 

«e V 



= sup 

«e V 



i{v) + DC{Uo) 



-i{v) - DC{Uo) 



fc=i 



(14) 



(15) 



(16) 



In the equation above DC{Uo) denotes the derivative of 
the function C at a point Uo on the Lie group S'[/(2"). 
Hence the function C (Eq ([12])) satisfies 



sup {~e{v)- DC{U) 
t>ev 



-i{Y,Vk{t)Hk]U 



fc=i 



= 0, (17) 



termed the Hamilton-Jacobi-Bellman (HJB) equation. In 
principle this solution C can be used to obtain bounds on 
the gate complexity as indicated in Eqns ([5]) and ([6|). As- 
suming regularity conditions, the optimal control policy 
is generated by the synthesis equations given below |13l . 
Section 1.5]. v* is optimal for an initial state Uq if and 
only \iv*{t) G R{U{t)) for all i > (almost everywhere), 
where 



R{U) := argmax <^ -DC{U) 

«GV 



-i{Y,Vk{i)Hk]U 
fe=i 



(18)' 

In these expressions we define U{t) := U{t] v, Uq) to be 
the solution to the differential equation Eq IH) at time t 
with control history v. 



C. Obtaining one and two qubit gate 
implementations 

We numerically synthesize the optimal controls using 
techniques such as in [IJ, Chapter 3] where the solutions 
to the discretized version tend towards the solution of the 
original continuous description. 

The solution to the HJB gives the control sequence 
to be applied to reach the identity element. This is the 
crucial step in the control synthesis. From the Baker- 
Campbcll-HausdorfF formula [1^ we know that 



exp{i {A + B) Ai} = cxp{i A At} x exp{i B Ai} 



0(At2) 
(19) 



where A and B arc any Hcrmitian operators. This im- 
plies that in a one qubit system, a unitary generated by 
any element of the Lie algebra of a one qubit system can 
be approximated as closely as desired by the product of 
unitaries generated by flowing along the available one 
and two qubit control Hamiltonians (given the bracket 
generating assumption mentioned previously). We now 
recall two statements regarding the universality of gates 
and gate synthesis using a product of two level unitaries 
below. 

1. A single qubit and a C-not gate are universal i.e 
produce any two level unitary [7|, Section 4.5.2]. 

2. An arbitrary unitary matrix on a d-dimensional 
Hilbert space can be written exactly as a product 
of two level unitaries [Tl, Section 4.5.1]. 



These statements together with Eq (flQl) indicate that 
once we have a control vector from the solution of the 
HJB equation, it is possible to synthesize a one and two 
qubit gate sequence to approximate a desired unitary to 
as good an accuracy as required. 



maximum magnitude), at each point on the manifold in 
order to reach the destination in the smallest possible 
time. Hence the direction (and thus the path) is chosen 
in order to minimize the the 'distance' along the mani- 
fold. Thus this minimum time control problem is related 
to the original gate complexity problem. The minimum 
time problem in quantum mechanics has also attracted 
interest in other articles [3, [l6, 17, 1^. 
The HJB for the cost function is: 

sup {-1 - DC{U) hi (wi /, + V2 h)U]} = (22) 

where U G SU{2). The optimal control is chosen ac- 
cording to the Eq P^ . 

Now, in order to obtain the numerical solution to this 
problem we proceed as follows. Instead of using the value 
function C directly, it is advantageous to use the mono- 
tone transformation (Kruskov transform) 



S{U) = 1 - e-^(^) , U e SUi2) 



(23) 



which leads to the following HJB equation (using |13l . 
Proposition 2.5]): 

S{U) + H{U,DS{U)) = 

1>S{U) > 0, U e SU{2)\I (24) 
S{I) — ( boundary condition ) 

with the Hamiltonian term H being the same as in 
Eq ((22|) . The function S can be interpreted as a 
discounted minimum time function for the system in 
Eq (|20p . Therefore from the Dynamic Programming 
principle S would satisfy 



tAtUgiv) 



S{Uo) 



~ inf 



'ds+ 



IV. EXAMPLE PROBLEM ON SU{2) 

We now use the theory introduced to consider an ex- 
ample on the special unitary group. We wish to construct 
any element of SU{2) using the available Hamiltonians 
Ix and Iz- The system dynamics on SU(2) is given by: 



dU 
at 



U e SU{2) (20) 



where v G V and 



X 2 



1 

1 



I, = - 
2 



-1 



(21) 



In this case £{.) :— 1. 

This cost function in effect measures the distance along 
the manifold to generate the desired unitary. Due to the 
fact that cost function does not depend on the magni- 
tude of the control signal applied, the problem essen- 
tially involves choosing the direction to flow along (with 



= -(*A*„„W)5(^(^^^^^(„).„^[;^)) 1 (25) 



This normalization (discounting) is useful for better 
numerical convergence and is also used in the unique- 
ness proofs of the solutions to the dynamic programming 
equations. 

To obtain a numerical solution to the dynamic pro- 
gramming problem, we parameterize points in SU(2) us- 
ing a mapping of the form exp(a Ix + bly + clz) from the 
Euclidian space. Note that the paramctrization is not 
unique, since multiple points in the three dimensional 
Euclidian space R.^ map to the same point in SU{2). 

Note that since HJB equation in this case is linear in 
w, the optimal v lies on the boundary of the compact set 
V at (almost) every time instant. This simplification re- 
flects the results from [l| where determining the geodesic 
(which are paths of constant magnitude of the velocity) 
involves choosing an optimal direction along which to 
flow. 



The method of discretization of Eqns ((241) ' which are 
used to obtain the simulation resuhs, will be described 
later in this article. Figure [1] indicates the slices along a 
quadrcnt of the co-ordinate axes of the actual minimum 
time function C (which corresponds via Eq ((23l) to the 
normalized minimum function S*, obtained by solving the 
HJB Eq dMl)). 

The figure is presented as a gray-scale image in a three 
dimensional grid. The axes correspond to the three pa- 
rameters used for the representation of SU(2) as de- 
scribed above. A lighter shading indicates a larger value 
of the minimum time function at a point, while a darker 
shading implies a smaller time to reach the identity ele- 
ment when starting from that point. 




FIG. 1: Un-normalized Optimal cost function with a control 
of norm 1 




FIG. 2: Path to the identity element starting at different 
points on each of tlie 3 axes. 

Time optimal trajectories for this example arc indi- 
cated in Figure [21 Note that the non-uniqueness of the 



representation leads to having to carefully interpret the 
paths when they are shown in flat space. Observe that 
since there is no direct vector field to control along /y, 
the path to the identity starting from a point along ly 
is not a straight line unlike in the case of the other two 
axes {Ix and 1^). 

The discretization of this system for obtaining numer- 
ical solutions to the HJB equation ([M|is carried out 
using the finite difference procedure in [ij, Section 6.5]. 
In three dimensional Euclidian space with a grid spacing 
h of the space and basis vectors e^, the value iteration 
equation (which is the iteration of the cost function, say 
S^ ) is given by: 



S'^ix) = inf { 
u 



i=l 



where 



5''± :=S^{x±he^) 
/;(.T,C/):=max{f(a;,C/),0} 
flixM):=-mm{r{x,U),0} 

ii/(^)iii:=EI|r(^)||- 



(26) 



Here P are the i th components of the vector valued 
function /. 

Note that the optimal control for this system is a spe- 
cific case of Eq p^ . where the possible values of the 
spatial co-ordinates are the locations of the grid points 
which in turn depend on the mesh generated for the dis- 
cretization. These discretizcd equations and the controls 
resulting therefrom arc used to obtain the simulation re- 
sults indicated in the figures in this article. Once the 
controls are determined, we can generate the one and two 
qubit unitaries which efficiently approximate this control 
trajectory as explained in Section UlI CI 



V. DISCUSSION AND CONCLUSIONS 

In this article we have described the use of the Dynamic 
programming method to solve the efficient gate synthesis 
problem and have demonstrated a proof of principle of 
this technique by obtaining a complete solution to an 
example problem of a single qubit. 

A comparison between the method introduced and al- 
gebraic decomposition based approaches (such as appli- 
cations of the methods in [1^ ) , is shown in [l^ ; wherein 
it is demonstrated that the results obtained by a decom- 
position based method agree well, to within the error 
bounds of the discretization, with those resulting from 
the dynamic programming based control method. 

The methods in the present article are sufficiently gen- 
eral to be able to be used with various cost functions 



such as the ones in Q as well those used in geometric 
approaches to the problem as in Q ■ 

The simulations in this work are based on theoretical 
results which are quite involved. A rigorous and com- 
plete development of the proofs of the foundations of this 
article will be deferred to a future publication. The nu- 
merical procedures outlined herein generalize to higher 
dimensional cases with the crucial limiting factor being 
the time taken and storage requirements for these compu- 
tations (which increases dramatically with the dimension 
of the system) . The treatment of problems of direct in- 
terest to gate complexity will require an analysis of uni- 
taries on three or more qubits. Owing to the curse of 



dimensionality, further work is required to develop com- 
putational methods of greater efficiency in order to use 
the Dynamic Programming technique to investigate these 
problems of practical interest. 
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